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Abstract 

The  Air  Force  images  space-borne  objects  from  the  ground  with  optical  systems  that 
suffer  from  the  effects  of  atmospheric  turbulence.  Many  image  processing  techniques 
exist  to  alleviate  these  effects,  but  they  are  computationally  complex  and  require  large 
amounts  of  processing  time.  A  faster  image  processing  system  would  greatly  improve 
images  of  objects  observed  through  the  turbulent  atmosphere  and  help  national  strategists 
glean  higher  quality  intelligence  on  other  nations’  space  platforms.  One  promising 
mathematical  method  to  decrease  the  computational  complexity  of  image  processing  al¬ 
gorithms  involves  symmetric  convolution.  Symmetric  convolution  is  a  recently  discov¬ 
ered  property  of  trigonometric  transforms  that  allows  the  convolution  of  sequences  to  be 
calculated  through  point  multiplication  in  the  trigonometric  transform  domain.  This 
method  holds  distinct  advantages  over  existing  matrix  techniques.  The  versions  of  the 
transform  matrices  for  symmetric  convolution  are  similar  but  not  exactly  equal  to  stan¬ 
dard  unitary  versions  of  trigonometric  transforms.  This  paper  demonstrates  relationships 
between  the  two  types  of  transform  matrices,  and  then  uses  the  new  relationships  to  de¬ 
rive  forms  of  the  symmetric  convolution-multiplication  property  based  on  unitary  rather 
than  convolutional  forms  of  the  transform  matrices.  It  further  describes  how  image  proc¬ 
essing  algorithms  based  on  unitary  transforms  can  be  included  in  future-generation  opti¬ 
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cal  surveillance  systems. 


Chapter  1 


Introduction 

The  Air  Force  has  a  need  to  image  space-borne  objects  from  the  ground.^  Air  Force 
analysts  can  use  these  images  to  discern  details  about  the  capabilities  of  an  adversary’s 
satellite  systems.  National  level  strategists  can  use  images  of  space-borne  platforms  to 
verify  compliance  with  existing  treaties  on  nonproliferation  of  space-based  weapons. 
When  trained  on  our  own  satellites,  ground-based  imaging  systems  can  also  provide  sat¬ 
ellite  maintainers  information  about  the  health  and  well-being  of  our  own  systems.  Ad¬ 
ditionally,  the  Air  Force  has  recently  entered  a  joint  venture  with  the  Jet  Propulsion 
Laboratory  to  detect  and  classify  the  orbits  of  asteroids  that  may  approach  the  orbital 
plane  of  the  earth.^ 

One  factor  severely  limiting  the  performance  of  ground-based  optical  systems  is  at- 
n 

mospheric  turbulence.*^  The  constant  motion  of  different  layers  of  the  atmosphere  causes 
the  indices  of  refraction  within  those  layers  to  change,  which  in  turn  causes  scattering  of 
the  light  captured  within  the  aperture  of  a  telescope  on  the  ground.  This  scattering  causes 
images  to  appear  much  more  blurred  than  if  the  turbulent  effects  of  the  atmosphere  were 
not  present.  The  objective  of  this  research  is  to  demonstrate  new  techniques  that  the  Air 
Force  can  use  to  improve  its  methods  of  collecting  information  on  space-borne  objects. 
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The  process  of  restoring  a  degraded  image  is  referred  to  as  image  reconstruction.^  A 

variety  of  mathematically  complex  convolutional  techniques  exist  to  perform  image  re- 

FI 

construction  via  filtering.  Symmetric  convolution  is  a  recently  discovered  property^of 
discrete  trigonometric  transforms  that  allows  for  the  filtering  of  images  to  be  calculated 
through  point  multiplication  in  the  trigonometric  transform  domain  at  a  tremendous  sav¬ 
ings  in  computational  complexity  over  computing  the  convolution  sum  directly.  Sym¬ 
metric  convolution  has  already  been  demonstrated  as  a  method  to  mathematically  en¬ 
hance  existing  image  reconstruction  techniques^  The  existing  form  of  the  symmetric 
convolution-multiplication  property  is,  however,  somewhat  limited  in  that  the  versions  of 
the  transform  matrices  for  symmetric  convolution  are  similar  but  not  exactly  equal  to  the 
standard  unitary  versions  of  trigonometric  transforms. 

This  paper  demonstrates  a  relationship  between  the  two  types  of  trigonometric  trans¬ 
form  matrices — convolutional  and  unitary.  It  then  proves  how  the  new  relationships  can 
be  used  to  derive  forms  of  the  symmetric  convolution-multiplication  property  based  on 
unitary  rather  than  convolutional  forms  of  the  transform  matrices.  The  paper  further  de¬ 
scribes  how  image  processing  algorithms  based  on  unitary  transforms  can  be  included  in 
future-generation  optical  surveillance  systems  to  improve  existing  image  reconstruction 
techniques  used  by  the  Air  Force. 

The  objectives  of  this  research  are  directly  related  to  the  Air  Force’s  core  compe¬ 
tency  of  information  superiority.  Air  Force  Doctrine  Document  1  (AFDD-1)  defines  in¬ 
formation  superiority  as  “the  ability  to  collect,  control,  exploit,  and  defend  information 

Fi 

while  denying  an  adversary  the  ability  to  do  the  same.’*-'  The  results  of  this  research  will 
help  the  Air  Force  in  its  efforts  to  collect  information  by  improving  techniques  to  miti- 
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gate  the  effects  of  atmospheric  turbulence.  The  end  results  of  these  efforts  will  enhance 
the  Air  Force’s  function  as  “the  major  operator  of  sophisticated  air-  and  space-based  in¬ 
telligence,  surveillance,  and  reconnaissance  systems  and  [as]  the  Service  most  able  to 

n 

quickly  respond  to  the  information  they  provide.” 

The  remainder  of  this  paper  is  organized  to  provide  the  reader  with  enough  informa¬ 
tion  to  understand  the  problem  as  well  as  grasp  the  benefits  offered  by  symmetric  con¬ 
volution.  Chapter  2  contains  general  background  information  on  how  the  Air  Force  cur¬ 
rently  images  space-borne  objects  from  the  ground.  Chapter  3  provides  technical  back¬ 
ground  information  on  image  reconstruction,  symmetric  convolution  and  the  discrete 
trigonometric  transforms,  and  on  how  symmetric  convolution  can  be  used  to  perform  im¬ 
age  reconstruction.  Chapter  4  derives  the  relationship  between  convolutional  and  unitary 
discrete  trigonometric  transforms  by  first  demonstrating  that  diagonal  matrices  exist 
which  relate  the  two  versions,  and  then  proving  that  new  vector-matrix  forms  of  the 
symmetric  convolution-multiplication  property  exist  that  are  based  on  unitary  rather  than 
convolutional  discrete  trigonometric  transforms.  Chapter  5  gives  a  proposal  for  how  im¬ 
age  processing  algorithms  based  on  the  new  unitary  versions  of  the  symmetric  convolu¬ 
tion-multiplication  property  can  be  included  in  future-generation  optical  surveillance 
systems  with  faster  processing  times  and  improved  image  quality.  Chapter  6  summarizes 
the  findings  and  outlines  directions  for  future  research. 
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Chapter  2 


General  Background 


This  chapter  provides  general  background  information  on  existing  Air  Force  meth¬ 
ods  for  imaging  space-borne  objects  from  the  ground.  In  particular,  it  discusses  Air 
Force  efforts  to  use  adaptive  optics  systems  and  laser  beacons  to  reduce  the  effects  of  at¬ 
mospheric  turbulence  as  well  as  describing  post-processing  techniques  to  reconstruct  im¬ 
ages. 

As  was  stated  earlier,  the  effects  of  turbulence  on  light  passing  through  the  atmos¬ 
phere  create  this  imaging  problem.  To  illustrate  the  severity  of  the  problem,  consider  that 
“at  [one  of]  the  best  observing  sights — in  Hawaii... — where  there  are  telescopes  of  up  to 
10  meters  in  diameter,  turbulence  still  limits  the  resolution  to  the  equivalent  of  that 
achieved  by  a  telescope  only  10  cm  in  diameter  [without  turbulence].”^  By  comparison, 
the  Hubble  space  telescope,  which  obviously  does  not  suffer  from  the  degrading  effects 
of  atmospheric  turbulence,  is  only  2  meters  in  diameter  but  cost  a  great  deal  to  launch 
into  orbit.  Bigger  telescopes  on  the  ground  allow  more  light  to  pass  through  their  aper¬ 
tures — a  necessary  feature  to  image  dim  objects. 

One  technique  to  reduce  the  effects  of  atmospheric  turbulence  is  through  the  use  of 
adaptive  optics.  Adaptive  optics  systems  use  a  wavefront  sensor  to  measure  the  scatter¬ 
ing  from  a  bright  object  in  the  vicinity  of  the  object  to  be  imaged.  The  system  sends 
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control  signals  to  a  series  of  actuators  that  physically  adjust  the  contour  of  a  telescope’s 

n 

deformable  mirror  to  correct  for  the  perturbations  caused  by  the  atmosphere.  The  sys¬ 
tem  must  correct  itself  about  100  times  each  second  to  keep  up  with  the  rate  of  changes  in 
the  atmosphere. 

0 

In  a  recent  Scientific  American  article,  John  Hardy,  a  pioneer  of  adaptive  optics  re¬ 
search  who  recently  retired  from  Litton  Itek  Optical  Systems,  describes  the  history  of  the 
first  operational  adaptive  optics  system.  He  states  that  the  project  began  in  the  1970s  as  a 
Defense  Advanced  Research  Projects  Agency  (now  ARPA)  effort  to  better  identify  the 
high  numbers  of  military  satellites  the  Soviet  Union  was  launching  at  the  time.  He  claims 
that  after  testing  a  prototype  system  with  21  actuators  in  December  1973,  ARPA  next  in¬ 
stalled  an  adaptive  optics  system  employing  168  actuators  on  a  1.6  meter  telescope  atop 
Mount  Haleakala  in  Maui,  Hawaii  in  1980.  The  system  was  first  tested  in  the  spring  of 
1982  with  impressive  results,  especially  for  images  of  binary  star  pairs.^ 

Today  Mount  Haleakala  is  home  to  the  Air  Force  Research  Laboratory’s  (AFRL’s) 
research  and  development  efforts  on  the  Maui  Space  Surveillance  System  (MSSS)  at  the 

Maui  Space  Surveillance  Complex  (MSSC),  formerly  the  Air  Force  Maui  Optical  Station 
n 

(AMOS).^  The  MSSS  instruments  all  suffer  from  the  effects  of  atmospheric  turbulence 

despite  the  fact  that  the  ten  thousand  foot  elevation  of  the  complex,  the  dry  climate,  and 

freedom  from  background  light  pollution  all  allow  unsurpassed  detection  of  satellites, 

□ 

missiles,  man-made  orbital  debris  and  astronomical  objects. 

In  a  recent  Physics  Today  article,^  Laird  Thompson,  professor  of  astronomy  at  the 
University  of  Illinois  at  Urbana-Champaign,  reports  on  recent  advances  in  adaptive  optics 
including  Air  Force  efforts  at  the  Starfire  Optical  Range  (SOR)  in  New  Mexico.  He  also 
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provides  background  information  on  a  technique  that  provides  an  alternative  to  the  re¬ 
quirement  of  an  adaptive  optics  system  to  have  a  bright  object  in  the  vicinity  of  the  object 
being  imaged.  This  technique  uses  a  laser  beacon  or  guide  “star”  which  is  a  beam  of  la¬ 
ser  light  shot  into  the  night  sky  that  scatters  off  molecules  in  the  stratosphere  at  altitudes 
of  10-20  km.  The  scattered  light  creates  the  same  effect  as  a  bright  natural  star  on  the 
order  of  0.1  magnitude.  Previous  adaptive  optics  systems  required  a  natural  star  in  the 
vicinity  of  the  object  to  be  imaged  to  measure  the  turbulence  with  a  wavefront  sensor. 
Thompson  further  discusses  research  efforts  to  use  experimental  lasers  to  scatter  light  off 
sodium  atoms  in  the  mesosphere  at  altitudes  of  95  km.  The  higher  altitude  would  de¬ 
crease  the  amount  of  anisoplanatism  or  angular  error  in  the  laser  guide  star  reference. 
Thompson  describes  the  explosive  growth  of  adaptive  optics  and  laser  guide  star  research 
in  the  early  part  of  this  decade: 

What  astronomers  thought  in  the  late  1980s  would  be  an  evolutionary  drift 
toward  adaptive  optics  turned  into  a  veritable  revolution  in  the  spring  of 
1991,  when  US  military  researchers  stepped  forward  to  announce  that  they 
too  haibeen  investing  in  both  adaptive  optics  and  laser-guide  star  re¬ 
search.^ 

Thompson  gives  three  reasons  he  suspects  led  to  the  military’s  decision  to  release  infor¬ 
mation  on  its  efforts  at  adaptive  optics  and  laser  guide  star  research.  He  offers  that  Euro¬ 
pean  researchers  had  prototyped  an  infrared  adaptive  optics  system,  his  own  team  at  the 
University  of  Illinois  had  published  the  results  of  successful  experiments  using  laser 
guide  stars,  and  these  results  coincided  with  the  end  of  the  cold  war.  Figure  1  from  the 
AMOS  webpagel^shows  a  laser  guide  star  in  action  on  the  top  of  Mount  Haleakala.  The 
system  in  use  is  known  as  SWAT  (for  short  wavelength  adaptive  technique).^  Accord- 
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Figure  1.  AMOS  Observatory 


ing  to  Hardy ,^this  system  was  proposed  by  Robert  Fugate  of  Phillips  Laboratory  and  de¬ 
veloped  by  researehers  at  M.I.T.  Lineoln  Laboratory. 

In  addition  to  adaptive  opties  with  natural  or  artifieial  guide  stars,  another  method  of 
performing  image  reeonstruetion  is  to  use  image  proeessing.^  Similar  to  adaptive  opties 
teehniques,  some  image  proeessing  systems  ean  measure  the  effeets  of  atmospherie  per¬ 
turbations,  and  then  use  a  eomputer  to  eorrect  for  the  effeets  of  the  distortion.  Sueh  sys¬ 
tems  are  often  ealled  post-proeessing  systems  sinee  they  perform  their  ealeulations  “after 
the  fact”  instead  of  “on  the  fly”  as  for  adaptive  optics  systems.  Other  image  processing 
techniques  require  no  a  priori  knowledge  of  the  turbulence.  They  do  not  require  a  wave- 
front  sensor  to  measure  the  turbulence,  and  instead  apply  nonlinear  iterative  algorithms  to 

deduce  both  a  turbulence-compensated  image  and  a  mathematical  model  of  the  turbu- 

n 

lence  that  caused  the  degradation  in  the  original  image.  Still  other  image  processing 

techniques  are  linear  in  nature,  i.e.  they  can  correct  an  image  in  a  single  direct  iteration, 

but  they  require  knowledge  of  at  least  the  statistics  of  the  turbulence  degrading  the  im- 

□ 

age.  These  techniques  require  fewer  computations  than  iterative  techniques,  but  they 
suffer  from  poorer  performance  than  either  wavefront  sensor  processing,  iterative  proc¬ 
essing,  or  adaptive  optics. 

The  tradeoff  between  computational  complexity  vs.  higher  performance  image  re¬ 
construction  algorithms  is  a  problem  of  interest  to  the  developers  of  the  next  generation 
of  Air  Force  optical  systems.  The  computational  speed  of  adaptive  optics  systems  limits 
the  number  of  frames  or  snapshots  that  the  system  can  obtain  each  second.  The  faster  a 
processor  can  perform  its  calculations  on  turbulence  measurements,  the  faster  the  system 
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can  provide  updates  on  changing  atmospheric  conditions.  Similarly,  the  faster  a  post¬ 
processing  technique  can  generate  a  turbulence-compensated  image,  the  faster  the  image 
can  be  sent  to  analysts  and  the  quicker  the  computer  can  be  turned  over  to  perform  cal¬ 
culations  on  other  images. 

The  mathematical  relationships  derived  in  later  chapters  of  this  paper  can  help  im¬ 
prove  the  performance  of  Air  Force  systems  using  adaptive  optics  by  increasing  the  speed 
of  transform  domain  calculations  used  to  correct  for  turbulence.  The  results  of  this  re¬ 
search  stand  to  pose  an  even  greater  benefit  to  linear  systems  that  perform  image  post¬ 
processing,  because  they  can  speed  up  each  calculation  within  an  iterative  algorithm. 
These  improvements  also  benefit  linear  direct-calculation  systems,  not  only  because  they 
perform  calculations  quicker,  but  also  because  the  trigonometric  transforms  upon  which 
they  are  based  have  performance  advantages  over  other  more  conventional  transforms.^ 

This  chapter  has  provided  a  brief  introduction  to  how  the  Air  Force  images  space- 
borne  objects  from  the  ground.  Prior  to  proceeding  with  the  derivations  contained  in  later 
chapters,  it  is  first  necessary  to  present  some  mathematical  background  information  in  the 
next  chapter. 


Notes 


‘  Ibid. 

^  Roggemann  and  Welsh,  Chapter  4,  123-168. 

^Both 

G.R.  Ayers  and  J.C.  Dainty,  “Iterative  Blind  Deconvolution  Method  and  its  Applica¬ 
tions,”  Optics  Letters  13,  no.  7  (July  1988):  547-549. 

and 

B.L.K.  Davey,  R.G.  Lane,  and  R.H.T.  Bates,  “Blind  Deconvolution  of  Noisy  Com¬ 
plex-Valued  Image,”  Optics  Communications  69,  no.  5,6  (January  15,  1989):  353-356. 

describe  iterative  techniques  to  solve  this  problem  known  as  blind  deconvolution. 

^  For  early  work  on  least-squares  linear  filtering,  see 

Carl  W.  Helstrom,  “Image  Restoration  by  the  Method  of  Least  Squares,”  Journal  of 
the  Optical  Society  of  America  57,  no.  3  (March  1967):  297-303. 
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Optical  Society  of  America  57,  no.  7  (July  1967):  918-922. 
and 
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Prentice-Hall,  1989),  Chapter  8,  267-341. 
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Mass.:  Addison-Wesley,  1992),  Chapter  5,  253-305. 
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Chapter  3 


Technical  Background 


This  chapter  lays  the  teehnical  foundation  upon  which  the  derivations  in  the  follow¬ 
ing  chapter  are  based  by  establishing  a  consistent  mathematical  notation  and  presenting 
the  results  of  previous  research  related  to  symmetric  convolution  and  its  applications  for 
image  reconstruction.  The  following  sections  supply  theoretical  information  on  the  basic 
image  reconstruction  problem,  symmetric  convolution  and  the  discrete  trigonometric 
transforms  (DTTs),  and  a  discussion  on  how  the  symmetric  convolution-multiplication 
property  can  be  applied  to  improve  linear  image  reconstruction  techniques. 

Image  Reconstruction 

Image  reconstruction  is  the  process  of  restoring  degraded  imagesP^  An  imaging  sys¬ 
tem  typieally  measures  a  blurred,  noisy  image  of  an  object.  In  the  problem  of  imaging 
space-borne  objects  from  the  ground,  the  blurring  is  caused  by  the  turbulent  atmosphere 

which  has  a  severe  degrading  effect  on  the  quality  of  imageJ^  and  random  noise  that  is 

[3I 

always  present  in  image  detection  systems.  The  system  must  then  apply  image  recon¬ 
struction  techniques  to  recover  an  estimate  of  the  object  from  its  blurred,  noisy  version. 
One  technique  used  to  perform  this  task  is  linear  filtering. 

To  help  illustrate  how  a  filter  can  recover  an  estimate  of  an  object  from  its  distorted, 
noisy  version,  consider  the  imaging  scenario  in  Figure  2.  In  the  figure,  the  two-dimen- 
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Figure  2.  Imaging  Scenario 


sional  sequence  0{n^ ,  )  represents  the  original  object,  where  the  indices  and  cor¬ 

respond  to  an  ordering  of  the  pixels  of  the  image.  The  two-dimensional  sequence 
h{n^ ,  )  represents  the  point  spread  function  of  the  system  blurring  the  object.  Optical 

scientists  and  engineers  refer  to  the  two-dimensional  impulse  response  of  the  degrading 
system  as  its  point  spread  function.  The  name  arises  from  the  blurring  or  spreading  of 
individual  points  comprising  the  object.^  The  scenario  adds  noise  represented  by  the  se¬ 
quence  w(nj,n2)  to  produce  the  received  data  sequence  d{n^,n2)  =  h{n^,n^)  *  9{n^,n^) 

+  w(n^,n2).  The  asterisk,  *,  denotes  the  convolution  operation,  which  can  also  be  ex- 
n 

pressed  as^^ 

h{n^,n^)*0{n^,n^)  =  0{m^,m^)h{m^—n^,m^—n^).  (1) 

mj  =-o^m2  =— oo 

The  recovery  filter  in  the  scenario  has  a  two-dimensional  impulse  response,  f(n^,n^),  so 

that  the  estimate  of  the  object  is  0{ny ,n^)=  /(n^ , ^2 )  *  d(ni , ^2 ).  The  goal  of  image  re¬ 
construction  with  a  linear  filter  is  to  find  the  impulse  response  of  the  recovery  filter, 
/(nj,n2),  which  produces  the  best  possible  estimate  0{n^,n^). 
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If  the  sequences  in  Eq.  (1)  are  spatially  limited  to  'XN2  pixels,  then  an  easier  way 

to  calculate  the  convolution  sum  is  to  first  convert  each  sequence  into  its  discrete  Fourier 

n 

transform  (DFT)  representation,  H(k^,k2)and0(k^,k2),  where 


V,-l  N2-I  r 

H(k^,k2)=  h(n^ , ^2 ) exp i  -  j  ‘  exp^  -  j 


rti=0  n2=0 


2mi2k2 


and 


Ni-l  N2-I 

0(k^,k2)=  6>(nj,n2)exp<j-7 


.  iTln^k^ 


exp^  -  J 


2m2k2 

iVo 


(2) 


A  well-known  property  of  DFTs  states  that  convolution  in  the  spatial  domain  is  equiva- 

ra 

lent  to  point-wise  multiplication  in  the  transform  domain  of  the  DFTsH  It  thus  requires 
fewer  calculations  to  perform  the  two  DFTs  in  Eq.  (2),  compute  the  product  H(k^,k2) 
X0(kj,k2)’  then  perform  an  inverse  DFT  to  yield  the  same  result  as  Eq.  (1).  Hunt^ 
has  shown  the  summations  in  Eqs.  (1)  and  (2)  can  be  expressed  as  a  vector-matrix  multi¬ 
plication,  and  that  matrices  representing  the  DFT  operation  can  diagonalize  a  matrix  rep¬ 
resenting  the  convolution  operation. 

Another  family  of  transforms  that  are  similar  to  the  DFT  and  useful  for  image  proc¬ 
essing  are  the  discrete  cosine  and  sine  transforms  (DCTs  and  DSTs).^  Until  recently  no 
convolution-multiplication  property  existed  for  the  discrete  trigonometric  transforms 
(DTTs),  so  their  application  to  image  reconstruction  filtering  is  a  relatively  new  concept. 


Symmetric  Convolution  and  the  Discrete  Trigonometric  Transforms 

The  discrete  cosine  transform  was  first  introduced  in  1974.^  Since  then  it  has  been 
expanded  into  an  entire  family  of  trigonometric  transforms^consisting  of  sixteen  DTTs 
which  are  even  and  odd-length  versions  of  the  DSTs  and  DCTs.  Another  characteristic 
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of  the  family  of  DTTs  is  that  each  transform  is  one  of  four  types  (I-IV)  that  impose  half¬ 
sample  shifts  in  the  input  or  output  indices  of  the  sine  and  cosine  transforms.  A  type-I 
trigonometric  transform  imposes  no  shift  to  either  the  input  or  the  output  sequence  indi¬ 
ces.  A  type-II  transform  imposes  a  half-sample  shift  to  just  the  input  index.  A  type-in 
transform  imposes  a  half-sample  shift  to  just  the  output  index.  A  type-IV  transform  im¬ 
poses  a  half-sample  shift  to  both  the  input  and  the  output  indices.  The  fact  that  these  four 
transforms  require  either  no  shift  or  a  half-sample  shift  is  related  to  the  idea  of  the  point 
of  symmetry  in  the  symmetric  extension  of  a  finite  sequence.  The  point  of  symmetry  can 
be  either  an  end  point  of  the  sequence  or  a  point  which  lies  one-half  sample  beyond  the 
end  point  of  the  sequence. 

There  are  four  ways  to  symmetrically  extend  a  finite  sequence  about  a  single  point  of 
symmetry.  These  are  whole-sample  symmetry  (WS),  whole-sample  antisymmetry  (WA), 
half-sample  symmetry  (HS),  and  half-sample  antisymmetry  (HA).  An  example  of  each 
appears  in  Figure  3.  Note  that  the  point  of  symmetry  for  the  WS  sequence  is  the  end 
point  in  the  finite  sequence  before  extension,  and  the  point  of  symmetry  for  the  WA  sequ- 


Figure  3.  Four  Ways  to  Symmetrically  Extend  a  Finite  Sequence!^ 
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ence  is  a  zero  that  must  appear  after  the  end  point  before  extension.  The  points  of  sym¬ 
metry  for  both  the  HS  and  HA  sequences  lie  one-half  sample  beyond  the  end  points  in 
each  finite  sequence  before  extension. 

There  are  16  symmetric  periodic  sequences  (SPS's)  which  result  from  symmetrically 
extending  a  finite  sequence  to  the  left  using  one  of  the  four  ways  and  to  the  right  using 
possibly  a  different  way.  A  convention  for  naming  each  of  the  16  SPS's  is  to  label  first 
the  left  symmetric  extension  and  then  the  right  symmetric  extension.  For  example,  a 
WSHA  sequence  would  exhibit  whole-sample  symmetry  to  the  left  and  half-sample  anti¬ 
symmetry  to  the  right.  A  one-to-one  correspondence  exists  between  the  sixteen  types  of 
SPS’s  and  the  sixteen  DTTs.^ 

Martucci^  has  recently  developed  a  convolution-multiplication  property  for  the 
family  of  DTTs  based  upon  the  underlying  symmetry  of  each  DTT.  He  defines  symmet¬ 
ric  convolution  as  the  form  of  convolution  for  DTTs.  The  symmetric  convolution- 
multiplication  property  states  that  an  inverse  trigonometric  transform  of  the  product  of 
the  trigonometric  transforms  of  two  sequences  yields  the  same  result  as  the  symmetric 
convolution  of  the  two  sequences.^  The  symmetric  convolution-multiplication  property 
exists  for  forty  different  combinations  of  the  sixteen  transforms  in  the  DTT  family  based 


on  the  underlying  symmetric  periodicities  of  the  different  DTTs. 


In  the  derivation  of  his  symmetric  convolution-multiplication  property, 


Martucci^ 


slightly  redefines  each  of  the  DTTs  into  what  he  refers  to  as  their  convolutional  versions. 


The  modifications  are  necessary  to  relate  each  DTT  to  the  more  generalized  DFT  of  Bon- 
ITtH 

giovanni  et  aV — 'upon  which  Martucci’s  derivation  is  based.  Definitions  for  each  of  the 


sixteen  convolutional  versions  and  for  each  of  the  more  traditional  versions  of  the  DTTs 
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appear  in  Appendix  A.  Note  that  the  traditional  versions  of  the  DTTs  are  all  represented 
by  unitary  matrices.  An  NxN  unitary  matrix,  U,  has  the  property  that  =U~\  or 
equivalently  UU^  =  /^,  where  the  superscript  T’  indicates  the  transpose  of  a  matrix  and 
the  matrix  I ^  is  an  NxN  identity  matrix. 

Martucci  defines  forty  cases  of  the  symmetric  convolution-multiplication  property 
based  on  the  sixteen  convolutional  versions  of  the  DTTs  listed  in  Appendix  A.  Just  as 
Hunt^presented  a  vector-matrix  relationship  for  the  convolution-multiplication  property 
of  the  DFT,  recent  researclP^has  revealed  diagonal  forms  of  the  symmetric  convolution- 
multiplication  property  for  each  of  the  forty  cases  of  symmetric  convolution.  Sanchez  et 
al.  have  previously  demonstrated  the  existence  of  diagonal  forms  of  the  convolutional 
versions  of  the  DTTs,  their  results  reveal  diagonalizing  forms  for  only  sixteen  of  the 
forty  cases  of  symmetric  convolution — one  case  of  symmetric  convolution  for  each  of  the 
sixteen  transforms.  The  vector- matrix  forms  of  all  forty  cases  appear  in  Appendix  B. 
The  advantages  to  a  vector-matrix  form  of  each  case  include  compactness  of  notation  and 
the  fact  that  the  property  extends  more  easily  to  asymmetric  multidimensional  sequences 
which  is  a  necessary  condition  to  apply  the  property  to  image  reconstruction. 

Image  Reconstruction  Using  Symmetric  Convolution 

This  section  demonstrates  results  for  the  two-dimensional  impulse  response  of  a  lin¬ 
ear  image  reconstruction  filter  that  is  optimum  in  the  mean-square  sense  for  reconstruct- 

I21  I 

ing  images  degraded  by  a  known  blurring  function  in  the  presence  of  additive  noise.' — ' 
Such  filters  are  commonly  referred  to  as  Wiener  filters  after  the  pioneering  work  of  Nor- 
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belt  Wiener  in  the  1940s.^  Both  HelstroirP^and  SlepiarJ^have  applied  Wiener  filters  to 
the  least-squares  image  reconstruction  problem. 

PratP  has  outlined  the  vector-matrix  form  of  the  image  reconstruction  problem 
which  is  to  find  the  filter  represented  as  a  matrix,  F,  that  produces  the  vector  estimate 
d  =  Fd  arising  from  linearly  corrupted  data  in  noise  from  the  relation  d  =  HO  +  w  de¬ 
picted  graphically  in  Figure  2.  The  estimate,  0,  should  be  the  estimate  which  minimizes 
the  mean-square  error  between  the  estimate  and  the  original  object  vector,  0.  The  solu¬ 
tion  for  the  filter,  F,  that  produces  the  minimum  mean-square  error  estimate,  6,  is  well 
documented  in  statistical  signal  processing  texts^as 

F=R,,H^[hR,,H^  +R„„\\  (3) 


where  R^g  and  R^^  are  correlation  matrices  for  the  object  and  noise  respectively. 
The  trigonometric  transform  domain  realization  of  Eq.  (3)  then  becomes 


^ss  (^1  ’  ^2  ) 


0l(K,k,) 


(4) 


where  the  script  letters  denote  that  the  quantities  lie  in  the  trigonometric  transform  do¬ 
main  and  the  subscripts  ‘ss’  indicate  the  relation  holds  only  for  functions  possessing 
whole-sample  symmetry  in  both  spatial  dimensions.  Note  that  Eq.  (4)  is  a  scalar  and  not 
a  matrix  relation.  The  scalar  nature  of  Eq.  (4)  arises  because  the  vector-matrix  form  of 
the  symmetric  convolution-multiplication  property  produces  a  diagonal  matrix  in  the 
transform  domain,  and  also  because  the  type-II  DCT  produces  a  nearly  diagonal  correla- 
tion  matrix  in  the  transform  domain  for  an  image  with  highly  correlated  pixels.' — '  This 
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fact  is  significant  because  scalar  relations  require  far  fewer  calculations  to  implement 
than  matrix  relations. 

One  limitation  of  Eq.  (4)  is  that  it  is  only  valid  for  the  convolutional  versions  of  the 
DTTs.  The  unitary  versions  of  the  DTTs  are  more  common  and  hardware  exists  to  incor¬ 
porate  fast  implementations  of  the  transforms.  The  next  step  in  this  process  is  to  derive 
forms  of  the  symmetric  convolution-multiplication  property  based  on  unitary  rather  than 
convolutional  versions  of  the  DTTs.  This  derivation  will  be  the  primary  focus  of  the  next 
chapter. 
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Chapter  4 


Relationship  between  Convolutional  and  Unitary  Transforms 


This  chapter  presents  the  mathematical  relationship  between  the  convolutional  ver¬ 
sions  of  the  discrete  trigonometric  transforms  (DTTs)  and  the  more  common  unitary  ver¬ 
sions  of  the  DTTs.  For  nine  out  of  the  sixteen  transforms  in  the  DTT  family,  the  relation¬ 
ship  is  diagonal.  The  diagonal  matrices  which  relate  the  two  versions  of  the  DTTs  then 
allow  the  vector-matrix  form  of  the  symmetric  convolution  property  to  be  cast  in  terms  of 
unitary  rather  than  convolutional  transforms.^ 


Diagonal  Matrices  Relating  the  Two  Versions 


This  section  demonstrates  the  relationships  between  each  of  the  sixteen  convolu¬ 
tional  DTTs  and  their  unitary  counterparts.  Consider  the  following  matrix  relationships 
between  convolutional  and  unitary  DTT  matrices: 


Cle  = 
Clo  = 


C  —AC 

^2e  ~  ^6^ lie 

C  -AC 

2o  ^10'-'  llo 
^2o  ~  A4’^IIo 


C  -AC 

3c  ^3'-'  IIIc 
^3e  ~  ^7*^ IIIc 

C  -AC 

'-'3o  ^ll'-'IIIo 
’^3o  “  As’^IIIo 


C  —AC 

4c  “  ^4'-'  IVc 
^4e  ~  ^8’^IVc 

C  -AC 

4o  ^12'-'  IVo 
’^4o  ~  ^16’^IVo  ’ 


(5) 


where  the  matrices  denoted  by  C  and  5  represent  discrete  cosine  and  sine  transform 
(DCT  and  DST)  matrices  respectively.  The  numeric  subscripts  ‘1-4’  represent  DTT 
transform  types  I-IV  for  the  convolutional  versions  of  DTT  matrices,  and  the  Roman 
numeral  subscripts  ‘I-IV’  represent  DTT  transform  types  I-IV  for  the  unitary  versions  of 
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DTT  matrices.  The  subscripts  ‘e’  and  ‘o’  denote  even  and  odd  length  versions  of  the 
DTT  matrices.  Complete  definitions  for  the  convolutional  and  unitary  versions  appear  in 
Appendix  A.  The  matrices  Aj- A^g  relate  the  two  versions  for  each  of  the  sixteen  DTTs. 

To  express  symmetric  convolution  in  terms  of  unitary  transforms,  only  those  matri¬ 
ces  from  Aj-Ajg  that  are  diagonal  are  useful  for  subsequent  derivations  because  the  ma¬ 
trix  form  of  symmetric  convolution  results  in  diagonal  matrices  in  the  trigonometric 
transform  domain.  It  is  straightforward  to  show  by  counterexample  that  the  matrices  A^, 
A3,  Aj,  Ag,  Ajg,  Ajj,  and  Ajg  are  not,  in  general,  diagonal.  To  show  that  the  matrix 
Aj  is,  in  general,  diagonal,  consider  that  the  matrix  is  unitary,  i.e.  =I 


NxN  identity  matrix,  which  allows  the  matrix  Aj  to  be  written  as  A^  =C2gCl^.  Re 


peating  the  definitions  for  the  m-nth  elements  of  the  NxN  type-II  even-length  DCT 
matrices  from  Appendix  A,  yields 


[CjJ  =2  cos 

L  Ze  Jmn 


N 


(6) 


and 


[C  1  -  Ik  co/^^^  +  ^^^ 


(7) 


for  m, n  =  0, 1,...,  A-1.  The  constant,  k^,  in  Eq.  (7)  differs  from  Wang  and  Hunt’s 


definition,^so  that 


= 


I ,  m  =  0,N 
1,  otherwise. 


(8) 


which  follows  the  convention  for  Martucci’s  convolutional  versions.  Equation  (7)  yields 
a  unitary  matrix  equivalent  to  Wang  and  Hunt’s  definitioiJ^  for  any  even  N.  It  follows 
from  Eqs.  (6)  and  (7)  that 
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[cj  =  — [c„] 

L  Ze -imn  \  Jc  *" 


The  m  -  nth  element  of  the  product  is  expressible  as 


[■^2  ]mtt  2e  ]m/7  lie  ]/?«  ’ 


which  after  substituting  the  result  of  Eq.  (9)  becomes 


-  N-l 

[c  1  \c^  1 

,  L'-'  lie  imp  L'-'  lie  ip 

^  n=n 


Because  is  unitary,  Eq.  (11)  can  be  recast  as 


[4]™= 


where  5{m-n)  is  a  Kronecker  delta  function  defined  by 


S{m-n)  ■■ 


1,  m  =  n 

0,  m^n. 


Erom  Eq.  (12),  is  clearly  diagonal  with  the  general  result  for  its  m-nth  element 


given  by 


f  24^ ,  m  =  n  =  0 
m  =  n^0 
1 0,  m^n. 


or  more  compactly,  A^  =  n  ■ 

Eollowing  similar  derivations,  it  follows  that  A^  =  Ag  =42NI A^=42NI,^_^, 
and  Ag  =  -,^1^  for  ^riy  positive  N  even,  and  Ajj  =  A13  =  A^^  =  A^  =  V2iv^A/^_j  for 
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any  positive  N  odd.  These  derivations  appear  in  Appendix  C.  Note  ^  Ag  even  though 


both  have  dimension  NxN,  because  Aj  is  indexed  from  0  to  N -I  and  Ag  must  be  in¬ 
dexed  from  1  to  A  based  on  the  index  ranges  of  the  type-II  DCT  and  DST  in  the  trigono¬ 
metric  transform  domain.^ 

Thus,  diagonal  relationships  exist  for  nine  out  the  sixteen  DTTs.  These  diagonal  re¬ 
lationships  then  allow  certain  of  the  vector-matrix  forms  of  the  symmetric  convolution- 
multiplication  property  of  the  DTTs  to  be  recast  in  terms  of  unitary  transforms. 

New  Vector-Matrix  Forms  of  Symmetric  Convolution 
Based  on  Unitary  Transforms 

To  relate  the  above  results  to  the  vector-matrix  forms  of  the  symmetric  convolution- 
multiplication  property,  consider  the  following  expression  which  represents  just  one  of 
the  forty  cases  of  symmetric  convolution^expressed  in  vector-matrix  form:^ 

d  =  C-lH,C,A  (15) 

In  Eq.  (15),  the  vectors  d  and  6  represent  the  input  and  output  sequences,  d(n)  and  0(n), 
and  the  matrix  H(.  =  }  is  the  diagonal  matrix  created  by  taking  the  even- 

length  convolutional  type-I  DCT  of  the  vector  which  represents  the  right-half  sam¬ 
ples  of  a  sequence  h(n)  having  whole-sample  symmetry  in  both  the  left  and  right  direc- 
□ 

tions.  Normally  the  vector  contains  A-l-1  samples  ranging  from  0  to  N,  but 

here  only  the  first  N  samples  from  0  to  N  -I  need  to  be  retained  because  the  underlying 
symmetry  of  the  vector  €2^^  forces  a  zero  at  m  =  N  which  cancels  the  value  of 
at  m  =  N.  A  more  thorough  explanation  of  the  underlying  symmetry  and  zero  values  in- 
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herent  in  symmetric  convolution  is  given  in  two  articles  by  Martucci.^  Thus  each  matrix 
in  Eq.  (15)  has  compatible  dimension  NxN.  Substituting  the  fact  that  €2^  =  ^2^ik 
Eq. (15)  produces 

d  =  C;lA-^H,A2C,J.  (16) 

Recognizing  that  the  three  interior  matrices  in  Eq.  (16)  are  diagonal  and  therefore  com¬ 
mute,  yields 

d  =  (17) 

which  is  the  desired  result  based  on  unitary  transform  matrices  for  this  particular  case  of 
symmetric  convolution.  A  similar  result  to  Eq.  (17)  based  on  operator  notation  first  ap¬ 
peared  in  a  conference  paper  by  Martucci.^  The  development  presented  here  follows  a 
matrix  approach  to  derive  not  only  this  result  but  also  results  based  on  unitary  transform 
matrices  for  other  cases  of  symmetric  convolution. 

Eighteen  of  the  forty  cases  of  symmetric  convolution  are  expressible  in  terms  of 
unitary  transform  matrices.  The  reason  not  all  of  the  cases  can  be  expressed  in  terms  of 
unitary  transform  matrices  is  because  seven  of  the  sixteen  DTTs  cannot  have  their  con¬ 
volutional  and  unitary  versions  related  by  a  diagonal  matrix.  Eollowing  a  similar  deriva¬ 
tion  as  that  producing  Eq.  (17),  the  following  eighteen  cases  are  based  on  unitary  trans¬ 
form  matrices: 


‘i  =  SyH,j^e 

‘i  =  sM,s,,e 

^  —  ^IVo 


d  = 

d  =  S^'H,J^e 
d  =  S-;H^J„fi 


d=s;:H,^c,„e 

d  —  5|]r„Ht  C.ij  0, 


(18) 
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where  the  subscripts  on  the  H  matrices  indicate  the  type  of  DTT  applied  to  the  right-half 
samples  of  the  sequence  h(n)  in  each  case.  All  the  derivations  for  the  cases  in  Eq.  (18) 
appear  in  Appendix  D.  The  derivations  for  the  cases  with  identical  forward  and  inverse 
unitary  transforms  are  straightforward.  The  derivations  for  the  odd-length  cases  with  dif¬ 
ferent  forward  and  inverse  transforms  occur  because  the  matrices  A^2~-^i5  relating  the 

odd  cases  are  all  identical.  The  remaining  derivations,  i.e.  those  for  the  even-length  cases 
with  different  forward  and  inverse  transforms,  use  either  the  fact  that  the  relating  matrices 
A4  and  Ag  are  identically  equal,  or  they  use  the  fact  that  the  matrices  Aj,  A5,  and  Ag 

are  identical  for  index  values  of  1  to  N -I . 

Equation  (18)  presents  the  symmetric  convolution-multiplication  property  of  DTTs 
based  on  unitary  rather  than  convolutional  transforms  for  the  eighteen  out  of  forty  total 
cases  where  it  exists.  The  results  based  on  unitary  rather  than  convolutional  transforms 
are  significant  because  many  applications  require  the  unitary  version  of  the  transform. 
Eor  example,  a  great  deal  of  hardware  on  the  market  today  performs  image  coding  based 
on  unitary  versions  of  the  DCT  and  DST.  Now  it  is  possible  to  perform  filtering  in  the 
transform  domain  of  the  DTTs,  without  having  to  first  convert  between  the  convolutional 
and  unitary  versions  of  the  transforms. 

The  following  chapter  shows  how  this  new  property  has  applications  to  the  image  re¬ 
construction  problem  imposed  by  imaging  through  turbulence. 

Notes 

*  Thomas  M.  Eoltz,  Byron  M.  Welsh,  and  Courtney  D.  Holmberg,  “Symmetric  Con¬ 
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Processing. 
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Chapter  5 


Proposal  for  Near- Real-Time  Imaging  System 


To  the  casual  observer,  perhaps  unfamiliar  with  the  mathematical  subtleties  pre¬ 
sented  in  the  previous  chapter,  it  might  appear  that  these  preliminary  results  are  insignifi¬ 
cant  in  that  they  simply  replace  a  few  numeric  subscripts  in  a  handful  of  equations  with 
Roman  numeral  subscripts.  On  the  contrary,  the  meaning  behind  the  change  of  subscripts 
is  what  is  significant.  However,  even  the  change  itself  would  be  purely  a  mathematical 
contrivance  were  it  not  for  the  potential  impact  the  change  has  to  improve  systems  in  the 
real  world. 

This  chapter  presents  some  ideas  for  ways  to  improve  existing  methods  of  imaging 
through  turbulence.  The  results  derived  in  this  paper  can  not  only  help  the  performance 
of  Air  Force  systems  using  adaptive  optics,  but  they  also  pose  an  even  greater  benefit  to 
systems  that  perform  image  processing  to  correct  for  turbulence  directly. 

The  techniques  developed  here  can  increase  the  speed  of  transform  domain  calcula¬ 
tions  used  to  correct  for  turbulence  in  adaptive  optics  systems.  The  increase  in  speed 
arises  because  for  real  sequences,  like  the  pixels  of  an  image,  the  trigonometric  transform 
domain  coefficients  are  also  all  real,  where  they  are  complex  in  the  Fourier  domain.  Fast 

algorithms  exist  for  the  discrete  trigonometric  transforms^  that  operate  with  the  same 

El 

number  of  floating  point  operations  as  fast  Fourier  transforms.  These  algorithms  use  on 
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the  order  of  A^logj  N  operations  to  compute  the  transform  of  an  image  with  N  pixels.  It 
follows  in  a  straightforward  manner  that  it  is  easier  to  perform  filtering  by  using 
A^logj  N  operations  to  calculate  the  forward  transform,  calculating  N  multiplications  in 
the  transform  domain,  and  then  performing  //log 2  N  operations  to  calculate  the  inverse 

transform,  than  it  is  to  compute  the  2N^  operations  needed  to  perform  convolution  di¬ 
rectly.  [Note  the  superscript  ‘2’  indicates  a  squaring  operation  and  not  an  endnote.] 

The  discrete  trigonometric  transforms  present  an  additional  savings  in  computational 
complexity  over  discrete  Fourier  transforms,  because  the  algorithms  use  all  real  arithme¬ 
tic  for  a  real-valued  image.  Complex  additions  require  twice  the  number  of  floating  point 
operations  as  real  additions  and  complex  multiplications  typically  require  six  times  the 
number  of  floating  point  operations  as  real  multiplications.  Because  images  that  are  in 
general  asymmetric  need  to  be  decomposed  into  their  four  underlying  symmetric  parts, 
the  overall  computational  savings  amounts  to  about  two-thirds  the  speed  of  existing  com¬ 
plex-arithmetic  algorithms.^ 

Embedded  into  the  processor  of  an  adaptive  optics  system,  algorithms  based  on  the 
unitary  versions  of  the  discrete  trigonometric  transforms  could  speed  up  the  refresh  times 
of  the  system,  giving  it  more  fidelity.  Being  able  to  process  measurements  from  wave- 
front  sensor  readings  in  two-thirds  the  existing  time  could  boost  the  measurement  rate 
from  100  to  150  Hz.  This  increase  would  allow  the  system  to  adapt  more  quickly  to 
changing  atmospheric  conditions. 

The  results  of  the  previous  chapter  can  also  improve  techniques  that  perform  image 
processing  to  restore  degraded  images.  Image  processing  systems  that  measure  the  ef¬ 
fects  of  atmospheric  perturbations  and  then  use  a  computer  to  correct  for  the  effects  of 
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the  distortion  can  also  operate  two-thirds  faster  than  existing  systems  by  using  trigono¬ 
metric  rather  than  Fourier  processing.  Other  image  processing  techniques  that  do  not 
measure  the  turbulence,  but  instead  apply  nonlinear  iterative  algorithms  to  reproduce  a 
turbulence-compensated  image,  stand  to  benefit  as  well.  The  overall  algorithms  will  take 
less  time  to  converge  because  each  iteration  will  require  less  processing  time,  and  they 

may  converge  in  fewer  iterations  because  trigonometric  transforms  provide  better  scalar 

n 

approximations  than  other  transforms.*^ 

Linear  image  processing  systems  that  compute  their  estimated  objects  directly  may 
stand  to  show  the  most  benefit  from  these  new  results  by  using  unitary  trigonometric 
transforms  to  compute  the  convolution  of  an  incoming  image  with  the  two  dimensional 
impulse  response  of  a  linear  reconstruction  filter  in  the  trigonometric  transform  domain. 
Since  hardware  based  on  the  unitary  versions  of  the  discrete  trigonometric  transforms  is 
readily  available,  it  is  conceivable  that  future  applications  might  lend  themselves  to  a 
real-time  hardware  systems  rather  than  delayed  computer  post-processing.  A  hardware- 
based  system  would  have  tremendous  advantages  in  speed  of  calculation,  and  could  be 
prototyped  in  a  laboratory  using  off-the-shelf  integrated  circuits  to  perform  the  trigono¬ 
metric  transforms. 

The  improvements  suggested  here  for  the  next  generation  of  ground-based  optical 

sensors  are  well  grounded  in  supporting  military  and  national  strategic  aims.  The  ideas 

presented  in  this  paper  stand  to  help  further  develop  the  Air  Force’s  core  competency  of 

n 

information  superiority^ by  collecting  vital  information  on  our  adversaries’  space-borne 
systems.  These  concepts  also  fit  within  the  National  Military  Strategy’s  charter  to 
“shape  the  international  environment,”  “respond  to  . . .  crises,”  and  “prepare  now  for  an 
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n 

uncertain  future.”^  Part  of  shaping  the  international  environment  calls  for  “preventing  or 

(71 

reducing  conflicts  or  threats,’’-'  and  specifically  mentions  reducing  the  development  of 

fsl 

technology  related  to  weapons  of  mass  destructionH  The  increased  quality  of  the  images 
generated  by  this  proposed  system  would  help  national  level  strategists  to  verify  compli¬ 
ance  with  existing  treaties  on  nonproliferation  of  space-based  weapons  and  enable  them 
to  respond  appropriately.  Joint  Vision  201cPlists  information  superiority  and  technologi¬ 
cal  innovations — two  areas  to  which  this  research  relates — as  supporting  concepts  ena¬ 
bling  the  military  forces  of  the  future  to  achieve  full  spectrum  dominance  during  peace¬ 
time  and  war.  All  of  these  military  concepts  derive  from  the  National  Security  Strategy 
Document,  which  discusses  intelligence,  surveillance,  and  reconnaissance  and  space  as 
two  overarching  capabilities  that  help  the  U.S.  advance  its  national  interests.^ 

Looking  years  ahead  into  the  future,  should  space-based  weapons  become  the  norm, 
then  the  system  proposed  here  could  provide  space  warfighters  with  near-real-time  battle 
damage  assessment  following  attacks  on  enemy  or  friendly  space  systems.  On  a  final 
note,  besides  their  applications  to  optical  systems,  the  technical  results  of  this  research 
can  also  benefit  other  areas  such  as  communications,  signal  processing,  and  control  sys¬ 
tems  applications,  even  though  the  original  focus  of  these  efforts  was  derived  specifically 
for  image  reconstruction. 
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Chapter  6 


Conclusion 

This  research  paper  has  documented  a  fundamentally  new  principle  regarding  image 
reconstruction.  It  has  presented  general  background  information  on  how  the  Air  Force 
images  space-borne  objects  from  the  ground.  It  has  introduced  readers  to  the  mathemati¬ 
cal  concepts  of  image  reconstruction,  symmetric  convolution  and  the  discrete  trigonomet¬ 
ric  transforms,  and  has  shown  how  symmetric  convolution  can  be  used  to  perform  image 
reconstruction.  The  results  presented  in  this  paper  that  relate  the  convolutional  and  uni¬ 
tary  trigonometric  transforms  and  present  unitary  transform  based  versions  of  the  sym¬ 
metric  convolution-multiplication  property  demonstrate  a  new  contribution  to  the  field. 

This  paper  has  proposed  that  image  processing  algorithms  based  on  unitary  trigono¬ 
metric  transforms  and  symmetric  convolution  would  enhance  existing  image  reconstruc¬ 
tion  systems.  Although  symmetric  convolution  is  a  fairly  recent  discoverjP  that  has  pre- 

[2I 

viously  been  applied  to  image  reconstruction,  it  relies  on  a  special  convolutional  form 
for  each  of  the  sixteen  discrete  trigonometric  transforms.  The  results  of  this  research  cast 
the  symmetric  convolution-multiplication  property  of  the  discrete  trigonometric  trans¬ 
forms  into  the  more  traditional  unitary  versions  of  the  discrete  trigonometric  transforms. 
By  performing  symmetric  convolution  with  unitary  rather  than  convolutional  transforms, 
faster  computational  and  even  direct  hardware  realizations  of  image  reconstruction  filters 
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are  possible  based  on  existing  discrete  cosine  transform  chips.  These  hardware  realiza¬ 
tions  can  then  be  used  to  improve  the  capability  of  ground-based  imaging  systems  that 
surveil  space-borne  objects,  an  Air  Force  function  well  grounded  in  service  and  military 
doctrine  as  well  as  military  and  national  strategy. 

Now  that  the  symmetric  convolution-multiplication  property  exists  for  unitary  trans¬ 
forms,  some  directions  for  future  research  might  include  recasting  existing  inverse  and 
scalar  Wiener  filters!^ in  terms  of  the  new  transforms.  Another  limitation  that  also  needs 

to  be  overcome  through  future  research  efforts  is  to  expand  the  noise  model  upon  which 

n 

the  scalar  Wiener  filter  is  based  to  include  photon-dependent  Poisson  noise.^-*  Enhancing 
the  noise  model  will  make  these  already  improved  techniques  even  more  robust. 


Notes 

*  Stephen  A.  Martucci,  “Symmetric  Convolution  and  the  Discrete  Sine  and  Cosine 
Transforms,”  IEEE  Transactions  on  Signal  Processing  42,  no.  5  (May  1994):  1038- 

1051. 

2 

T.M.  Foltz  and  B.M.  Welsh,  “Image  Reconstruction  Using  Symmetric  Convolution 
and  Discrete  Trigonometric  Transforms,”  Journal  of  the  Optical  Society  of  America  A  15, 
no.  11  (November  1998):  2827-2840. 

^Ibid. 

Michael  C.  Roggemann  and  Byron  M.  Welsh,  Imaging  Through  Turbulence. 
(Boca  Raton,  Fla.:  CRC  Press,  1996),  44-54. 
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Appendix  A 


Convolutional  and  Unitary  Discrete  Trigonometric  Transforms 


This  appendix  provides  definitions  of  the  sixteen  convolutional  versions  of  the  dis¬ 
crete  trigonometric  transforms  (DTTs)  and  the  sixteen  unitary  versions  of  the  DTTs. 

Martucci^defines  the  sixteen  convolutional  versions  of  the  discrete  cosine  and  sine 


transforms  (DCTs  and  DSTs)  by  their  m-nth  elements  as: 

7Tm.n'\ 


[C.J  =2A:„cos 

•-  1^  -*m«  w 


N 


(Al) 


[C2.L=2cos 


7an{n  +  \)'\ 


N 


m,n  =  Q,\,  ...,N (A2) 


[C,J  =2^  cos 

L  5e  Amn  n 


7r(m  +  -^)n^ 


N 


m,n  =  0,l,...,N  -I,  (A3) 


\C.A  =2  cos 

L  Ae  Amn 


N 


m,n  =  0,l,...,N -I,  (A4) 


[5,^]  =2sin 

L  1^  Amn 


7tmn\ 

N  ^ 


m,  n  =  1,  2, A -1,  (A5) 


[5,1  =2  sin 

L  le  -imn 


7an{n  +  ^) 
N 


m  =  l,  2, A 
n  =  0, 1,...,  A-1, 


(A6) 


[5,1  =2A:  sin 

L  3e  Amn  n 


7r(m  +  ^)n 

A 


m  =  0,l,...,  A-1 
n  =  l,  2,...,N, 


(Al) 
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where  p  can  be  either  m  or  n.  The  matrices  denoted  by  C  and  5  represent  DCT  and 
DST  matrices  respectively,  the  numeric  subscripts  ‘1-4’  represent  types  I-IV  for  the 
convolutional  versions  of  the  DTTs,  and  the  subscripts  ‘e’  and  ‘o’  denote  even  and  odd 
length  versions  of  the  DTT  matrices. 
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the  sixteen  unitary  versions  of  the  DTTs  by  their  m-nth 


elements  as: 


\C,A  =1 — kk„cos 

L  le  Jmn  ^  ni  n 


7ann\ 

N  ' 


[Cj, 


N 


-k^  cos 


7mi{n  +  \)'\ 


V 


N 


\c  I  -  f^cosf 


N 


N 


2  .  f 7ann\ 
■sin 


N 


=1 — k^&m 

L  lie  Amn  1  yy  tn 


7an(n  +  \)'\ 


N 


[S,.J 


N 


-k„  sin 


7r(m  +  j)n^ 


V 


N 


N 


N 


kk„ 


[C,„L=2J^cos 


iTOnn 

2N-1 


[^IIo  ]m/i 


'  k  I 

m  n 

2N-\ 


■cos 


2mi(n  +  ^ 
2N-1 


[Cm„L-2J  ^;;^cos 


27t{m  +  \)n^ 


2N-\ 


[c,J. 


■V2A^-1 


2A^-1 


m,n  =  Q,l,...,N , 

m,n  =  Q,l,  ...,N 

m,n  =  Q,l,  ...,N 

m,n  =  Q,l,  ...,N 

m,n  =  \,2,...,N 

m  =  l,2,...,  N 
n  =  0,l, ...,  N -1, 

m  =  0,l, ...,  N -1 
n  =  l,  2,...,N, 

m,n  =  Q,l,  ...,N 

m,n  =  Q,\,  ...,N 

m,n  =  Q,l,  ...,N 

m,n  =  Q,\,  ...,N 

m,n  =  Q,l,  ...,N  -  2, 


(A18) 

(A19) 

(A20) 

(A21) 

(A22) 

(A23) 

(A24) 

(A25) 

(A26) 

(A27) 

(A28) 

(A29) 
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m,n  =  \,2,...,N (A30) 


m  =  l, 

n  =  Q,\,...,N -2, 


(A31) 


2;r(m  +  i)n'^ 
2A-1 


m  =  0,l,...,  A-2 
n  =  \,  2,...,A-1, 


(A32) 


Fc  1  O  Lh  •  ( 2;r(m  +  i)(n  +  i)^ 

5iv„  =2. — 2Li!_sin  - ^ ^  . 

ivoJ„„  \2N-\  [  2N-\ 


m,n  =  0,\,  ...,N  (A33) 


The  definitions  in  Eqs.  (A18)-(A33)  differ  slightly  in  appearance  from  those  given  by 
lil 

Wang  and  Hunt,  but  they  produce  exactly  the  same  unitary  transform  matrices.  The  dif¬ 
ferences  arise  because  Eqs.  (A18)-(A33)  use  the  constants  given  by  Eq.  (A17)  and  the 
indexing  on  certain  of  the  DST  matrices  is  different.  The  only  reason  for  defining  the 
DTT  matrices  differently  is  to  allow  a  more  direct  comparison  to  Martucci’s  convolu¬ 
tional  versions  of  the  DTTs.^ 


Notes 

*  Stephen  A.  Martucci,  “Symmetric  Convolution  and  the  Discrete  Sine  and  Cosine 
Transforms,”  IEEE  Transactions  on  Signal  Processing  42,  no.  5  (May  1994):  1038- 

1051. 

2 

Zhongde  Wang  and  B.R.  Hunt,  “The  Discrete  W  Transform,”  Applied  Mathematics 
and  Computation  16,  no.  1  (January  1985):  33-35. 

^Ibid. 

^  Martucci,  1050. 
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Appendix  B 


Forty  Cases  of  Symmetric  Convolution 


This  appendix  lists  the  forty  cases  of  symmetric  convolution.  The  cases,  appearing 
in  vector-matrix  form.^\re: 


1. )  d=C-‘H,,C„d 

2. )  d  =  s;,'H,  s„e 

3. )  d=-c;;H,j„e 

4. )  d=c;:H,  c,,e 

5. )  d=st,H,c„e 

6. )  d=s;:H,j,,e 

7. )  d=-c;',H,j,,e 

8. )  d=c;',H,c,fi 
9) 

10. )  d=-c;;H,j„e 

11. )  d=cilH^c„e 

12. )  d=s-^Hc,  s^e 

13. )  d=-c;:H,j„e 

14. )  d=c;lH,  c„e 

15. )  d=s;lH,  c„e 

16. )  d=s;lH,j„e 

17. )  d=-cilH,,  s„e 

18. )  d=c-,:H,  c^,e 

19. )  d  =  s;iH,  c„e 

20. )  d=-cilH,j„e 


21. )  d=c;;H,,  c„e 

22. )  d  =  s;;H^j,,e 

23. )  d  = 

24. )  d  =  c;lH,s,fi 

25. )  d  =  StH,J,„e 

26. )  d  =  SllH,J,,e 

27. )  d  =  -c;lH,j,fi 

28. )  d  =  C-‘H^,_C,„d 

29. )  d  = 

30. )  d=-c;lH,  j,,e 

31. )  d  =  Cf,H,C,fi 

32. )  d  =  s;lH,j^e 

33. )  d=-c;lH,j,„e 

34. )  d  =  CllH,C,fi 

35. )  d  =  s:iH,j^e 

36. )  d  =  sZHs,  c,.e 

37. )  d  =  -CZH,J,fi 

38. )  d  =  CZH,C,^e 

39. )  d  =  SZH,^  C„e 

40. )  d  =  -CZH,JtA 


(Bl) 
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Notes 


*  Stephen  A.  Martucci,  “Symmetric  Convolution  and  the  Discrete  Sine  and  Cosine 

Transforms,”  IEEE  Transactions  on  Signal  Processing  42,  no.  5  (May  1994):  1050. 

2 

Maj  Thomas  M.  Foltz,  “Trigonometric  Transforms  for  Image  Reconstruction,” 
Ph.D.  Dissertation,  AFIT/DS/ENG/98-04.  Air  Force  Institute  of  Technology  (AETC), 
Wright-Patterson  APB,  Ohio,  June  1998,  1-122. 
and 

Poltz  and  B.M.  Welsh,  “Symmetric  Convolution  of  Asymmetric  Multidimensional 
Sequences  Using  Discrete  Trigonometric  Transforms,”  to  appear  in  IEEE  Transactions 
on  Image  Processing  8,  no.  5  (Mayl999). 
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Appendix  C 


Derivation  of  Diagonal  Relationships  between 
Convolutional  and  Unitary  Transform  Matrices 


This  appendix  displays  derivations  of  the  nine  diagonal  relationships  that  exist  be¬ 
tween  the  convolutional  and  unitary  versions  of  the  discrete  cosine  and  sine  transforms 
(DCTs  and  DSTs).  The  derivation  in  Chapter  4  showing  that  the  matrix  Aj  is  diagonal  is 
repeated  here  for  completeness. 


Diagonal  Relationship  for  Type-II  Even-Length  DCT 


Consider  the  matrix  A2  =  C2eCl^.  Recall  the  definitions  for  the  m-nth  elements  of 


the  NxN  type-II  even-length  DCT  matrices  from  Appendix  A: 


[CjJ  =2  cos 

L  Ze  ■imn 


V 


N 


(Cl) 


and 


\C  1  - 


(C2) 


for  m,n  =  0,l,...,  A-1.  The  constant,  k^,  in  Eq.  (C2)  is  defined  in  Eq.  (A17).  It  fol¬ 
lows  from  Eqs.  (Cl)  and  (C2)  that 


[C2  ]  =  — [C„  ]  . 

L  Ze -imn  \  Jc 


(C3) 
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The  m  -  nth  element  of  the  product  A2  =  is  expressible  as 


N-l 


[■^2  ]m/!  2e  ]m/7  lie  ’ 


p=0 


which  after  substituting  the  result  of  Eq.  (C3)  becomes 


N-l 


1  =  [(7  1  \£T  1 

L  2  Jmrt  -1 1  7  L'^  lie  Jm/?  L'^  He  Jpn  * 

*  /7=0 


Because  the  matrix  Cjj^  is  unitary,  Eq.  (C5)  can  be  recast  as 


U2L=.  ^S{m-n), 


(C4) 


(C5) 


(C6) 


where  d(m-n)  is  a  Kronecker  delta  function.  Erom  Eq.  (C6),  Aj  is  clearly  diagonal 
with  the  general  result  for  its  m  -  nth  element  given  by 

f  24^ ,  m  =  n  =  0 

[A2i^^={4w,  m  =  n^0  (C7) 

1^0,  m^n. 


or  more  compactly,  A2  = 


Diagonal  Relationship  for  Type-IV  Even-Length  DCT 


Consider  the  matrix  A^  =  Recall  the  definitions  for  the  m-nth  elements  of 


the  NxN  type-IV  even-length  DCT  matrices  from  Appendix  A: 


[C,  1  =2  cos 

L  4e  Jm« 


V 


N 


(C8) 


and 


[C,v,l 


cos 


.;r(m -I- D(n -I- ^ 


N 


(C9) 
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for  m,  n  =  0, 1 , . . . ,  - 1 .  It  follows  from  Eqs.  (C8)  and  (C9)  that 

[c’4,L=V2iv[c„,L.  (CIO) 

The  m  -  nth  element  of  the  product  is  expressible  as 

A^-l 

kL=  kiJcLi.,  (cii) 

p=0 

which  after  substituting  the  result  of  Eq.  (CIO)  becomes 

N-\ 

[aL=V^  [Civ.UC,],..  (C12) 

P=Q 

Because  the  matrix  is  unitary,  Eq.  (C12)  can  be  recast  as 

KL=V^^(m-n),  (C13) 

from  which  it  is  clear  that  =^1NI. 

Diagonal  Relationship  for  Type-I  Even-Length  DST 

Consider  the  matrix  A^  =  Recall  the  definitions  for  the  m-nth  elements  of 

the  -  lx  - 1  type-I  even-length  DST  matrices  from  Appendix  A: 

r„  1  ^  .  ( TOnn^ 

KL=2sin|^— (C14) 
and  [S„]  =,p)smf— \  (C15) 

L  leimn  ^  ^  ^  ^  ^ 

for  m,  n  =  1,  2, A -1.  It  follows  from  Eqs.  (Cl 4)  and  (Cl 5)  that 

[S..L=V2V[sJ.„,  (C16) 

The  m  -  nth  element  of  the  product  A^  =  S^^Sl,  is  expressible  as 
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(C17) 


[“^Ic  \mp  [“^Ic  \pn  ’ 


which  after  substituting  the  result  of  Eq.  (Cl 6)  becomes 


U5L=v^ 


(C18) 


Because  the  matrix  5j^  is  unitary,  Eq.  (C18)  can  be  recast  as 


(C19) 


from  which  it  is  clear  that  A,  =^[2NI. 


Diagonal  Relationship  for  Type-II  Even-Length  DST 


Consider  the  matrix  A^^  =  52^5/,^.  Recall  the  definitions  for  the  m-nth  elements  of 
the  NxN  type-II  even-length  DST  matrices  from  Appendix  A: 


[sj 

L  ze  Amn  ^ 


(C20) 


[5  1  =  i  + 

y  lleLn  V  ^  ^  I  ^ 


(C21) 


for  m  =  l,2,...,N  and  n  =  0,l,...,  A-1.  The  constant,  k^,  in  Eq.  (C21)  is  defined  in 
Eq.  (A17).  It  follows  from  Eqs.  (C20)  and  (C21)  that 


[5  1  =  ^[5  1 

2e  Amn  ^  lie  Amn  * 


(C22) 


The  m  -  nth  element  of  the  product  Ag  =  is  expressible  as 


[■^6  ]m/2  ' 


(C23) 
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which  after  substituting  the  result  of  Eq.  (C22)  becomes 


kL,=,|^  [s,.UsLf,  (C24) 

'  ^  p=0 

Because  the  matrix  5jj^  is  unitary,  Eq.  (C24)  can  be  recast  as 

kL  =  (C25) 

for  m,n  =  l,2,...,N,  from  which  Ag  is  clearly  diagonal  with  the  general  result  for  its 
m  -  nth  element  given  by 

f  ^2N ,  m  =  n^  N 

[AgL=^2Viv,  m  =  n  =  N  (C26) 

1^0,  m^n. 


or  more  compactly,  Ag  = 


Diagonal  Relationship  for  Type-IV  Even-Length  DST 


Consider  the  matrix  Ag  =  Recall  the  definitions  for  the  m-nth  elements  of 


the  NxN  type-IV  even-length  DST  matrices  from  Appendix  A: 


KL=2sin 


N 


(C27) 


and 


N 


N 


(C28) 


for  m,  n  =  0, 1 , . . . ,  A  - 1 .  It  follows  from  Eqs.  (C27)  and  (C28)  that 


[’^4e]m«  -  ^J2.N 


(C29) 


The  m  -  nth  element  of  the  product  Ag  =  54^5^  is  expressible  as 
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N-l 

kL=  [s„Us.v,L.  (C30) 

p=0 

which  after  substituting  the  result  of  Eq.  (C29)  becomes 

N-l 

kL=V2N  (C31) 

p=0 

Because  the  matrix  5jv^  is  unitary,  Eq.  (C31)  can  be  recast  as 

[AX„=^f^S(m-n),  (C32) 

from  which  it  is  clear  that  Ag  =^2NI. 

Diagonal  Relationship  for  Type-IV  Odd-Length  DCT 


Consider  the  matrix  =€^^€1^^.  Recall  the  definitions  for  the  m-nth  elements 
of  the  -  lx  - 1  type-IV  odd- length  DCT  matrices  from  Appendix  A: 


[C,J 

L  4oUn  ^  2N-1 

(C33) 

and 

\r  ]  -  ^  „^/2;r(m  +  i)(n  +  i)^ 

V2F^  1  2A-1 

(C34) 

for  m,  n  =  0, 1 , . . . ,  A  -  2.  It  follows  from  Eqs.  (C33)  and  (C34)  that 

[C4.L=V2i^[C,v,L-  (C35) 

The  m-nth  element  of  the  product  expressible  as 

N-2 

IAuL=  [c.J.jc.v.L.  (C36) 

p=0 

which  after  substituting  the  result  of  Eq.  (C35)  becomes 
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(C37) 


N-l 


U.J.,.=V2i^  [c,v„UclL 


p=Q 


Because  the  matrix  is  unitary,  Eq.  (C37)  can  be  recast  as 


U12  L  =  V2A^-l^(m  -  n). 


from  which  it  is  clear  that  =  •V2A^  -1/. 


Diagonal  Relationship  for  Type-I  Odd-Length  DST 


Consider  the  matrix  Ajj  =  Recall  the  definitions  for  the  m-nth 


the  -  lx  - 1  type-I  odd-length  DST  matrices  from  Appendix  A: 

^  iTtmn  ^ 


[SyA  =2sin 

L  LO  Jmn 


2N-1 


and 


[sj. 


2  .  f  2mnn 

sin 


V2A-1 


2N-1 


for  m,  n  =  1 ,  2, . . . ,  A  - 1 .  It  follows  from  Eqs.  (C39)  and  (C40)  that 

[S.J.,  =  V2F:T[s„L  , 


The  m-nth  element  of  the  product  Aj3  =  is  expressible  as 


N-l 


[■^13  [*^1(3  L  bio  ]„ 


p=i 


which  after  substituting  the  result  of  Eq.  (C41)  becomes 

N-l 


p=l 


Because  the  matrix  Sj^  is  unitary,  Eq.  (C43)  can  be  recast  as 


(C38) 

elements  of 

(C39) 

(C40) 

(C41) 

(C42) 

(C43) 
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UbL  =  V2A^-l^(m-n), 


(C44) 


from  which  it  is  clear  that  =  ^J2N -II 


Diagonal  Relationship  for  Type-II  Odd-Length  DST 

Consider  the  matrix  =  S2oS^^.  Recall  the  definitions  for  the  m-nth  elements  of 
the  -  lx  - 1  type-II  odd-length  DST  matrices  from  Appendix  A: 

^  2mn(n  -I-  i)  ^ 


[52„]  =2  sin 

L  zo  J/nn 


V 


2A-1 


(C45) 


and 


V2A-1 


sm 


2mn(n  -I-  i) 
2A-1 


(C46) 


for  m  =  1 ,  2, . . . ,  A  - 1  and  n  =  0, 1 , . . . ,  A  -  2.  It  follows  from  Eqs.  (C45)  and  (C46)  that 


[*^20  L«  —  V2A  l[>Si,oL. 


(C47) 


The  m-nth  element  of  the  product  A^^  =  is  expressible  as 


N-2 


[■^14  ]mn  ~  [*^20  \np  IIo  j  pn  ’ 


p=0 


which  after  substituting  the  result  of  Eq.  (C47)  becomes 

N-2 

[s.d,„[sLL 


p=0 


(C48) 


(C49) 


Because  the  matrix  5jj^  is  unitary,  Eq.  (C49)  can  be  recast  as 

U„L=V2iV-W(m-«), 

for  m,  n  =  1 ,  2, . . . ,  A  - 1,  from  which  it  is  clear  that  =  •V2A  -1/ 


(C50) 
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Diagonal  Relationship  for  Type-III  Odd-Length  DST 


Consider  the  matrix  Ajj  =  Recall  the  definitions  for  the  m-nth  elements  of 


the  -  lx  - 1  type-III  odd- length  DST  matrices  from  Appendix  A: 

^  2;r(m -I- ^ 


[5,„]  =2  sin 

•-  jO  Afnn 


V 


2A-1 


(C51) 


and 


V2A-1 


srn 


27r(m  +  j)n^ 

2N-1  ' 


(C52) 


for  m  =  0, 1, A  -  2  and  n  =  1,  2, A  -1.  It  follows  from  Eqs.  (C51)  and  (C52)  that 


[*^30  Ln  —  ■\l2.N  l[>SiiioL. 


(C53) 


Observe  that  both  the  convolutional  and  unitary  type-III  DSTs  are  the  transposes  of  type- 
II  DSTs  so  that  53^  =  “  ’^i^-  The  matrix  that  relates  the  convolutional  and 

unitary  type-III  DSTs  can  thus  be  expressed  in  terms  of  type-II  DSTs  as  A^j  =  or 

equivalently  Afj  =  so  that  substituting  the  result  of  Eq.  (C53)  produces 


a;=V2W-1S:.S 

=  V2A-1/, 


(C54) 


for  m,n  =  0,l, N  -2,  which  is  clearly  diagonal  so  that  Ajj  =  V2A-1/. 

These  nine  derivations  demonstrate  the  general  diagonal  relationships  that  exist  be¬ 
tween  convolutional  and  unitary  discrete  trigonometric  transforms  (DTTs).  Seven  DTTs 
do  not  have  a  diagonal  relationship  in  general,  which  can  be  easily  demonstrated  by 
counterexample. 
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Appendix  D 


Derivation  of  Symmetric  Convolution  Cases 
Based  on  Unitary  Transform  Matrices 


This  appendix  presents  derivations  of  the  eighteen  cases  of  symmetric  convolution 
that  can  be  based  on  unitary  transforms.  The  appendix  details  each  of  the  forty  cases 
from  Appendix  B  and  provides  reasons  why  each  case  does  or  does  not  exist  in  terms  of 
unitary  transform  matrices. 


Even-Length  Cases 


Case  1 

Case  1,  rf  =  C"‘Hc  Ci,0,  is  not  expressible  in  terms  of  unitary  transform  matrices 
because  the  matrix  is  not,  in  general,  diagonal. 

Case  2 

Case  2,  which  states  that 

d  =  s;;H,j„e.  (Di) 

is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  Hf,  =  diag\c } 

normally  contains  N  +  l  samples  ranging  from  0  to  A  along  its  diagonal,  but  here  only 
the  samples  from  1  to  N -I  need  to  be  retained  because  the  underlying  symmetry  of  the 
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vector  forces  zeros  at  m  =  0  and  m  =  N  which  cancel  the  values  of  at 

m  =  0  and  m  =  N.  Thus  each  matrix  in  Eq.  (Dl)  has  compatible  dimension 
N  -lx  N  -1.  Substituting  the  fact  that  5^^  =  into  Eq.  (Dl)  produces 

d  =  S-jA;'H,_A,S^e.  (D2) 

where  the  three  interior  matrices  in  Eq.  (D2)  commute,  resulting  in 

d  =  (D3) 

which  is  the  desired  result  based  on  unitary  transform  matrices  for  Case  2. 

Case  3 

Case  3,  =  -C"‘Hs  is  not  expressible  in  terms  of  unitary  transform  matrices 

because  the  matrix  =  C^jCl,  is  not,  in  general,  diagonal. 

Case  4 

Case  4,  which  states  that 

d  =  c;lHc,Ci,o.  (D4) 

is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  =  diag\c } 

normally  contains  + 1  samples  ranging  from  0  to  N  along  its  diagonal,  but  here  only 
the  first  N  samples  from  0  to  N  -I  need  to  be  retained  because  the  underlying  symmetry 

of  the  vector  forces  a  zero  at  m  =  N  which  cancels  the  value  of  at  m  =  N. 

Thus  each  matrix  in  Eq.  (D4)  has  compatible  dimension  NxN.  Substituting  the  fact  that 
iiito  Eq.  (D4)  produces 

d  =  C2A-^H,^A,C,,^e,  (D5) 
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where  the  three  interior  matrices  in  Eq.  (D5)  commute,  resulting  in 

(D6) 

which  is  the  desired  result  based  on  unitary  transform  matrices  for  Case  4. 

Case  5 

Case  5,  which  states  that 

rf=S,;‘Hs„C,,e,  (D7) 

is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  =  diagjSi^^^^^^} 
contains  N  samples  ranging  from  1  to  - 1  along  its  diagonal,  so  that  only  the  last 
- 1  samples  of  the  vector  from  1  to  N  need  to  be  retained  because  the  un¬ 
derlying  symmetry  of  the  vector  forces  a  zero  at  m  =  0  which  cancels  the  val¬ 

ues  of  the  vector  C^jd  at  m  =  0.  Thus  each  matrix  in  Eq.  (D7)  has  compatible  dimen¬ 
sion  N -I'kN Substituting  the  facts  that  52g=Ag5„^  and  into 

Eq.  (D7)  produces 

d  =  (D8) 

where  the  three  interior  matrices  in  Eq.  (D8)  commute,  resulting  in 

d  =  (D9) 

because  the  matrices  A2  and  Ag  are  identical  over  index  values  of  1  to  N  -I,  and  which 
is  the  desired  result  based  on  unitary  transform  matrices  for  Case  5. 

Case  6 

Case  6,  which  states  that 

d  =  s;lH,j^e,  (DIO) 


53 


is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  =  diag{Ci^^^5j,,5  } 

normally  contains  + 1  samples  ranging  from  0  to  along  its  diagonal,  but  here  only 
the  last  N  samples  from  1  to  A^  need  to  be  retained  because  the  underlying  symmetry  of 
the  vector  5 2^0  forces  a  zero  at  m  =  0  which  cancels  the  value  of  at  m  =  0. 

Thus  each  matrix  in  Eq.  (DIO)  has  compatible  dimension  NxN.  Substituting  the  fact 
that  82^=  ^6-^ Ik  Eq.  (DIO)  produces 

d  =  s;lAi^H,^A,s,^e,  (Dll) 

where  the  three  interior  matrices  in  Eq.  (Dll)  commute,  resulting  in 

d  =  s;lH,s,j,  (D12) 

which  is  the  desired  result  based  on  unitary  transform  matrices  for  Case  6. 

Case  7 

Case  7,  which  states  that 

d  =  (D13) 

is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  =  diag{5l^^(^2iw'A} 
contains  A^  - 1  samples  ranging  from  1  to  N  along  its  diagonal,  so  that  only  the  first 
N  samples  of  the  vector  82^6  from  1  to  N  -I  need  to  be  retained  because  the  un¬ 
derlying  symmetry  of  the  vector  forces  a  zero  at  m  =  N  which  cancels  the  val¬ 

ues  of  the  vector  82^6  at  m  =  N.  Thus  each  matrix  in  Eq.  (D13)  has  compatible  dimen¬ 
sion  N -IxN -1.  Substituting  the  facts  that  and  -S2g=Ag5„^  into 

Eq.  (D13)  produces 

d  =  -C2AtH,^A,8,J,  (D14) 
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where  the  three  interior  matrices  in  Eq.  (D14)  commute,  resulting  in 

(D15) 

because  the  matrices  Aj  and  Ag  are  identical  over  index  values  of  1  to  - 1,  and  which 
is  the  desired  result  based  on  unitary  transform  matrices  for  Case  7. 

Case  8 

Case  8,  d  =  C;^Hc^  C^^e,  is  not  expressible  in  terms  of  unitary  transform  matrices 
because  the  matrix  Aj  =  Cj^Cj^  is  not,  in  general,  diagonal. 

Case  9 

Case  9,  which  states  that 

rf=S-‘H,,C„e,  (D16) 

is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  =  diagjSjg^HAHA} 

contains  N  samples  ranging  from  1  to  along  its  diagonal,  so  that  only  the  last  A^  - 1 
samples  of  the  vector  from  1  to  N need  to  be  retained  because  the  underlying 

symmetry  of  the  vector  S forces  a  zero  at  m  =  0  which  cancels  the  values  of  the 
vector  C2eB  at  m  =  0.  Thus  each  matrix  in  Eq.  (D16)  has  compatible  dimension 
N  -lx  N  -1.  Substituting  the  facts  that  5;^  =  AjSj^  and  =  AjCj,^  into  Eq.  (D16) 
produces 

d  =  S;:A-^Hs^A2C,,A  (D17) 

where  the  three  interior  matrices  in  Eq.  (D17)  commute,  resulting  in 

d  =  S-'H,^C,^e.  (D18) 
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because  the  matrices  and  are  identical  over  index  values  of  1  to  - 1,  and  which 
is  the  desired  result  based  on  unitary  transform  matrices  for  Case  9. 

Case  10 

Case  10,  d  =  -Ci“'Hs^  is  not  expressible  in  terms  of  unitary  transform  matri¬ 
ces  because  the  matrix  Aj  =  is  not,  in  general,  diagonal. 

Case  11 

Case  11,  d  =  C^^d,  is  not  expressible  in  terms  of  unitary  transform  matrices 

because  the  matrix  A3  =  is  not,  in  general,  diagonal. 

Case  12 

Case  12,  d  =  is  not  expressible  in  terms  of  unitary  transform  matrices 

because  the  matrices  A3  =  and  A^  =  are  not,  in  general,  diagonal. 

Case  13 

Case  13,  d  = S,^0,  is  not  expressible  in  terms  of  unitary  transform  matri¬ 
ces  because  the  matrices  A3  =  and  Aj  =  are  not,  in  general,  diagonal. 

Case  14 

Case  14,  which  states  that 

(D19) 

is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  =  diagjCj^^^^^j,^  } 
contains  N  samples  ranging  from  0  to  N  -1  along  its  diagonal,  so  that  each  matrix  in 
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Eq.  (D19)  has  compatible  dimension  NxN.  Substituting  the  fact  that  into 

Eq.  (D19)  produces 

(D20) 

where  the  three  interior  matrices  in  Eq.  (D20)  commute,  resulting  in 

rf=C-‘,Hc.C„,e,  (D21) 

which  is  the  desired  result  based  on  unitary  transform  matrices  for  Case  14. 

Case  15 

Case  15,  which  states  that 

d=S2H,^C„e,  (D22) 

is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  =  diaglSj^^^^pj,^} 

contains  N  samples  ranging  from  0  to  N  -  \  along  its  diagonal,  so  that  each  matrix  in 
Eq.  (D22)  has  compatible  dimension  NxN.  Substituting  the  facts  that  54^  =  and 

into  Eq.  (D22)  produces 

d  =  S;iA-^H,^A,C,y^e,  (D23) 

where  the  three  interior  matrices  in  Eq.  (D23)  commute,  resulting  in 

d  =  s;iH,^c,y^e,  (D24) 

because  the  matrices  A4  and  Ag  are  identical,  and  which  is  the  desired  result  based  on 

unitary  transform  matrices  for  Case  15. 

Case  16 

Case  16,  which  states  that 

d=S;lH,S^,e,  (D25) 
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is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  =  diagjCj^^^^^^  } 

contains  N  samples  ranging  from  0  to  - 1  along  its  diagonal,  so  that  each  matrix  in 
Eq.  (D25)  has  compatible  dimension  NxN.  Substituting  the  fact  that  54^  =  Ag5jy^  into 
Eq.  (D25)  produces 

d  =  (D26) 

where  the  three  interior  matrices  in  Eq.  (D26)  commute,  resulting  in 

d  =  (D27) 

which  is  the  desired  result  based  on  unitary  transform  matrices  for  Case  16. 

Case  17 

Case  17,  which  states  that 

d=-c;lH,j„e  (D28) 

is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  =  diaglSg^^^^pj,^} 
contains  N  samples  ranging  from  0  to  N  -  \  along  its  diagonal,  so  that  each  matrix  in 
Eq.  (D28)  has  compatible  dimension  NxN.  Substituting  the  facts  that  =  A^C^y^  and 

54^  =  Ag5jv^  into  Eq.  (D28)  produces 

d  =  -c;iA;^H,^A,s,y^e,  (D29) 

where  the  three  interior  matrices  in  Eq.  (D29)  commute,  resulting  in 

d  =  -c;iH,s,y^0,  (D30) 

because  the  matrices  A4  and  Ag  are  identical,  and  which  is  the  desired  result  based  on 
unitary  transform  matrices  for  Case  17. 
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Case  18 


Case  18,  d  =  is  not  expressible  in  terms  of  unitary  transform  matrices 

because  the  matrix  A3  =  is  not,  in  general,  diagonal. 

Case  19 

Case  19,  d  =  S;‘H.C,A  is  not  expressible  in  terms  of  unitary  transform  matrices 
because  the  matrix  Aj  =  is  not,  in  general,  diagonal. 

Case  20 

Case  20,  d  =  is  not  expressible  in  terms  of  unitary  transform  matri¬ 
ces  because  the  matrix  A3  =  is  not,  in  general,  diagonal. 

Odd-Length  Cases 

Case  21 

Case  21,  d  =  C;^Hc  C,^e,  is  not  expressible  in  terms  of  unitary  transform  matrices 
because  the  matrix  A^  =  is  not,  in  general,  diagonal. 

Case  22 

Case  22,  which  states  that 

d  =  (D31) 

is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  =  diagjCj^^^^^^^  } 

normally  contains  N  samples  ranging  from  0  to  N  -I  along  its  diagonal,  but  here  only 
the  samples  from  1  to  - 1  need  to  be  retained  because  the  underlying  symmetry  of  the 
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vector  forces  a  zero  at  m  =  0  which  cancels  the  value  of  at  m  =  0.  Thus 

each  matrix  in  Eq.  (D31)  has  compatible  dimension  -  lx  -1.  Substituting  the  fact 
that  5i„  =  Ai35j„  into  Eq.  (D31)  produces 

rf  =  «,->„■  He, (D32) 
where  the  three  interior  matrices  in  Eq.  (D32)  commute,  resulting  in 

=  (D33) 

which  is  the  desired  result  based  on  unitary  transform  matrices  for  Case  22. 

Case  23 

Case  23,  rf  =  -C"‘Hs  is  not  expressible  in  terms  of  unitary  transform  matrices 

because  the  matrix  is  not,  in  general,  diagonal. 

Case  24 

Case  24,  d  =  C~lHc^  C,^9,  is  not  expressible  in  terms  of  unitary  transform  matrices 
because  the  matrices  Ag  =  C^jCl^  and  Ajg  =  are  not,  in  general,  diagonal. 

Case  25 

Case  25,  which  states  that 

d  =  StH,J„e,  (D34) 

is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  =  diag^ ^o^hsws  } 

normally  contains  N  samples  ranging  from  0  to  N  -I  along  its  diagonal,  but  here  only 
the  samples  from  1  to  A^  - 1  need  to  be  retained  because  the  underlying  symmetry  of  the 
vector  forces  a  zero  at  m  =  0  which  cancels  the  value  of  C^Ji^sv/s  m  =  0.  Thus 
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each  matrix  in  Eq.  (D34)  has  compatible  dimension  N  -lx  N  -1.  Substituting  the  facts 
that  S20  =  ^4-^110  ^lo  -  iiito  Eq.  (D34)  produces 

rf=S,->-'Hc.,A,3S,„S,  (D35) 

where  the  three  interior  matrices  in  Eq.  (D35)  commute,  resulting  in 

rf  =  S,.e,  (D36) 

because  the  matrices  Ajj  and  Aj^  are  identical,  and  which  is  the  desired  result  based  on 
unitary  transform  matrices  for  Case  25. 

Case  26 

Case  26,  which  states  that 

d  =  (D37) 

is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  Hf,  =  diag{Cj„^^5^5  } 

normally  contains  N  samples  ranging  from  0  to  N  -I  along  its  diagonal,  but  here  only 
the  samples  from  1  to  - 1  need  to  be  retained  because  the  underlying  symmetry  of  the 
vector  S2o0  forces  a  zero  at  m  =  0  which  cancels  the  value  of  at  m  =  0.  Thus 

each  matrix  in  Eq.  (D37)  has  compatible  dimension  N  -  lx  N  -1.  Substituting  the  fact 
that  S20  =  Ai45jj„  into  Eq.  (D37)  produces 

‘i  =  s;:A;:H,^A„s,^e.  (D38) 

where  the  three  interior  matrices  in  Eq.  (D38)  commute,  resulting  in 

=  (D39) 

which  is  the  desired  result  based  on  unitary  transform  matrices  for  Case  26. 


61 


Case  27 


Case  n,d=-CZH,S,fi,  is  not  expressible  in  terms  of  unitary  transform  matri¬ 
ces  because  the  matrix  is  not,  in  general,  diagonal. 

Case  28 

Case  28,  d  =  is  not  expressible  in  terms  of  unitary  transform  matrices 

because  the  matrices  Ag  =  and  Ajg  =  are  not,  in  general,  diagonal. 

Case  29 

Case  29,  which  states  that 

d  =  s-;H,j,,e.  (D40) 

is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  =  diag^ 2o^hsws  } 

normally  contains  N  samples  ranging  from  0  to  N  -I  along  its  diagonal,  but  here  only 
the  samples  from  1  to  - 1  need  to  be  retained  because  the  underlying  symmetry  of  the 
vector  S2„0  forces  a  zero  at  m  =  0  which  cancels  the  value  of  at  m  =  0.  Thus 

each  matrix  in  Eq.  (D40)  has  compatible  dimension  -  lx  A^  - 1.  Substituting  the  facts 
that  5j^  =  Aj35j^  and  =  Aj4Sjj^  into  Eq.  (D40)  produces 

d  =  (D41) 

where  the  three  interior  matrices  in  Eq.  (D41)  commute,  resulting  in 

=  (D42) 

because  the  matrices  Ajj  and  A14  are  identical,  and  which  is  the  desired  result  based  on 

unitary  transform  matrices  for  Case  29. 
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Case  30 


Case30,  rf  =  -C,;'H,  is  not  expressible  in  terms  of  unitary  transform  matri¬ 
ces  because  the  matrix  is  not,  in  general,  diagonal. 

Case  31 

Case  31,  is  not  expressible  in  terms  of  unitary  transform  matrices 

because  the  matrix  is  not,  in  general,  diagonal. 

Case  32 

Case  32,  which  states  that 

d  =  (D43) 

is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  =  diagjCj^^^^^^  } 

normally  contains  N  samples  ranging  from  0  to  N  -I  along  its  diagonal,  but  here  only 
the  samples  from  0  to  N  -2  need  to  be  retained  because  the  underlying  symmetry  of  the 
vector  forces  a  zero  at  m  =  N  -I  which  cancels  the  value  of  at  m  =  N  -I . 

Thus  each  matrix  in  Eq.  (D43)  has  compatible  dimension  -  lx  - 1.  Substituting  the 
fact  that  into  Eq.  (D43)  produces 

d  =  (D44) 

where  the  three  interior  matrices  in  Eq.  (D44)  commute,  resulting  in 

d  =  (D45) 

which  is  the  desired  result  based  on  unitary  transform  matrices  for  Case  32. 
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Case  33 


Case  33,  d  = is  not  expressible  in  terms  of  unitary  transform  matri¬ 
ces  because  the  matrix  is  not,  in  general,  diagonal. 

Case  34 

Case  34,  which  states  that 

d  =  C2H,^C,„e.  (D46) 

is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  =  diag{c3„^^5^^  } 

normally  contains  N  samples  ranging  from  0  to  N  -I  along  its  diagonal,  but  here  only 
the  samples  from  0  to  N  -2  need  to  be  retained  because  the  underlying  symmetry  of  the 
vector  forces  a  zero  at  m  =  N-l  which  cancels  the  value  of  at 

m=  N Thus  each  matrix  in  Eq.  (D46)  has  compatible  dimension  N -lx  N -1. 
Substituting  the  fact  that  =  AjjCjy^  into  Eq.  (D46)  produces 

d  =  (D47) 

where  the  three  interior  matrices  in  Eq.  (D47)  commute,  resulting  in 

(D48) 

which  is  the  desired  result  based  on  unitary  transform  matrices  for  Case  34. 

Case  35 

Case35,  rf=S.-‘H.  S,„e,  is  not  expressible  in  terms  of  unitary  transform  matrices 
because  the  matrix  A^g  =  S4„Sjv„  is  not,  in  general,  diagonal. 
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Case  36 


Case  36,  d  =  is  not  expressible  in  terms  of  unitary  transform  matrices 

because  the  matrix  is  not,  in  general,  diagonal. 

Case  37 

Case  37,  which  states  that 

(D49) 

is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  =  disLg{s ] 

normally  contains  N  samples  ranging  from  0  to  N  -I  along  its  diagonal,  but  here  only 
the  samples  from  0  to  N  -2  need  to  be  retained  because  the  underlying  symmetry  of  the 
vector  forces  a  zero  at  m  =  N-l  which  cancels  the  value  of  at 

m=  N -I .  Thus  each  matrix  in  Eq.  (D49)  has  compatible  dimension  N -lx  N -1. 
Substituting  the  facts  that  and  =  Aj^Sjjj^  into  Eq.  (D49)  produces 

d  =  (dso) 

where  the  three  interior  matrices  in  Eq.  (D50)  commute,  resulting  in 

=  (D51) 

because  the  matrices  Ajj  and  A^^  are  identical,  and  which  is  the  desired  result  based  on 
unitary  transform  matrices  for  Case  37. 

Case  38 

Case  38,  d  =  C^^0,  is  not  expressible  in  terms  of  unitary  transform  matrices 

because  the  matrix  A^  =  is  not,  in  general,  diagonal. 
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Case  39 


Case  39,  which  states  that 

d  =  s;lH,s,fi.  (D52) 

is  expressible  in  terms  of  unitary  transform  matrices.  The  matrix  =  diag{54„^^^^j  } 

normally  contains  N  samples  ranging  from  0  to  - 1  along  its  diagonal,  but  here  only 
the  samples  from  0  to  N -2  need  to  be  retained  because  the  underlying  symmetry  of  the 
vector  forces  a  zero  at  m  =  N-l  which  cancels  the  value  of  at 

m=  N Thus  each  matrix  in  Eq.  (D52)  has  compatible  dimension  A^-lx  A^-1. 
Substituting  the  facts  that  and  =  AjjCjy^  into  Eq.  (D52)  produces 

d  =  (D53) 

where  the  three  interior  matrices  in  Eq.  (D53)  commute,  resulting  in 

d=S:l,H,_C„,e,  (D54) 

because  the  matrices  Ajj  and  A^^  are  identical,  and  which  is  the  desired  result  based  on 
unitary  transform  matrices  for  Case  39. 

Case  40 

Case  40,  d  =  is  not  expressible  in  terms  of  unitary  transform  matri¬ 
ces  because  the  matrices  A^  =  and  A^^  =  S4^Sjv^  are  not,  in  general,  diagonal. 
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